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NASA’s Orion spacecraft is built to take humans to Mars effectively and safely 


To monitor spaceflight status and provide instructions to crew, cockpit has new software 
embedded digital displays to replace hundreds of pounds of paper documentations 


Digital displays have three glass screens to show graphical objects that are manipulated 
on screen using peripheral switches such as edge keys and knobs 
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Motivation 


- Many physical man-hours go into monotonous and manual software 
verification of human spacecraft displays 


- Need a more automated, robust and thorough verification method for 
Orion's cockpit displays to reduce human error 
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Goal 


- Verify the display software using an automation tool such as 
EKegPlant Functional 


- Develop a framework to allow for repeatability and consistency of 
verification of different display items 


What is EggPlant? 


- Verification Software that utilizes image recognition 


- Automation capabilities through simulation of user inputs 
> Clicks 
- Keyboard Keystrokes 


- User-like testing method 
- Recognition of object on screen followed by a click or keystroke 


- Thorough and long duration tests through automation 


- Knowledge of background code or internal processes not needed 


How Does EggPlant Work? 


- EggPlant Functional works in a Controller — System Under Test Relationship 
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How Does EggPlant Work? 
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& Demo.suite -- C:\Users\Carrie\Documents\Eggplant Suites — Calculator 
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Connection Control Window Help 


DoubleClick WaitFor 
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put file "C:\Users\Carrie\My Documents\Suite Accessories\numbers.txt" 
math 


connect "Windows 7" 


LaunchWindowsApp "wordpad”, "CalcReadLR" 
LaunchWindowsApp "calculator", "Edit" 


Repeat with each line myline of math 
typetext item 1 of myline 
typetext keypadPlius 
typetext item 2 of myline 
typetext Return 
Click "edit’ 

Click “copy’ 

Click "Clear 

Click "WPBottom' 
TypeText ControlKey, “v 
TypeText Return 

Click "CalcBottom 


end Repeat 
Click "WPBottom" 


put ReadText(("CalcReadUL"),("CalcReadLR")) into CalculationResult 
Put CalculationResult into file 
"C:\Users\Carrie\Desktop\calculationresults.txt' 


Put (6&Return&3&Return&5&Return&2&Return&5) into Expected 
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19-Aug-15 10:57:01.001 Exception 
StartButton 

returned: File Not Found: click Error - Could Not Open Image: StartButton 
LaunchWindowsApp "wordpad", "CalcReadLR" 

19-Aug-15 10:58:15.015 click StartButton at (26, 538) 
19-Aug-15 10:58:16.016 click RunLine at (47, 489) 


Could Not Open Image: 


19-Aug-15 10:58:16.016 typetext 
19-Aug-15 10:58:16.016 typetext 
19-Aug-15 10:58:17.017 waitfor 


wordpad 
{return] 
CalcReadLR found at (406, 379) 


How Does EggPlant Work? 


- Verifies nominal function by recognizing an image that appears ata 
specific instance during a test. 
- Images are captured prior to testing. 


- An example test on Windows OS would be recognizing an image of the 
Windows Start Menu after clicking on the Windows logo on the Windows 
Taskbar. 


- Comes with a GUI to write test automation scripts for your System 
Under Test. 


- Uses a language called SenseTalk for its scripts. 


- Scripting is intuitive. 
- Code user interactions with simple EggPlant commands 


How Does EggPlant Work? 


Example Code: 


Clickimage:"sample_image", waitfor:5) // Click image 


Typetext "Sample text." // Type "Sample text" 


ImageFound(Image:"sample_ image") // Conditional Statement 


// Returns True or False 


Display Unit are split into: 
Upper Left Quadrant 
Upper Right Quadrant 
Lower Left Quadrant 
Lower Right Quadrant 
Top Navigation Quadrant 
Bottom Navigation Quadrant 


Framework Definitions 
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Display Unit 1 DUI 
Display Unit 2 DU2 
Display Unit 3 DU3 
Cursor Control Device 1 CCD1 
Cursor Control Device 2 CCD2 


Display Calls DC 
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EK_Upper left click 1 ULC1 3 

EK_Upper left click 2 ULC2 *31 31 31 

EK_Upper left click 3 ULC3 *32 32 32 

EK_Upper left click 4 ULC4 *33 33 33 

EK_Upper left click 5 ULC5 *34 34 34 
EK_Upper left release 1 ULR1 '30 ;30 \30 
EK_Upper left release 2 ULR2 ‘31 331 \31 
EK_Upper left release 3 ULR3 ‘32 332 \32 
EK_Upper left release 4 ULR4 ‘33 333 \33 


EK_Upper left release 5 ULRS ‘34 334 \34 


Schematic of the 
main Edge Keys 
with their assigned 
variable names. 
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Schematic of the 
miscellaneous Edge 
Keys with their 
assigned variable 
names. 
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Display Software Verification 


Example Code: 


put a ae 
into 


//Navigates to MPS Display 
put DU1.FIt_MPS 


//Click and release 2 edge key buttons 
put DU1.URCR1 
put DU2.LRCR3 


Conclusions and Future Work 


- A display test script run multiple times on EggPlant Functional proved verification 
was carried out successfully 


- EggPlant Functional and SenseTalk proved to be highly useful tools for automating 
the testing of the Orion cockpit display simulators. 


- The Edge Key framework and Common EggPlant Function scripts enabled to write 
modular and re-usable code to apply to different displays and their items: 
* popup types 
> enumerations. 


- Common Eggplant Functions can be used repeatedly in tests of other displays, and 
such iterative testing will help validate reliability and consistency of simulation of 
Orion cockpit display software. 
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